Understanding the Importance of Data Lineage in Modern Data Management
Updated: 2023-12-28 17:51:25
Data lineage is a component of modern data management that helps organizations understand the origins, transformations, and movement of their data. It is like a road map that shows us where our data has been, how it has changed, and where it is going, just like tracking the journey of a package: from the person …
The post Understanding the Importance of Data Lineage in Modern Data Management appeared first on Simple Talk.
Aggregation is a widely used way to summarize the content of a database. It is usually expressed with GROUP BY clause or just using aggregate functions (like COUNT or SUM). When the database engine executes a query with aggregations, it produces individual rows need to compute the required output and then performs the aggregation as …
The post Eager Aggregation in SQL queries appeared first on Simple Talk.
MongoDB is a document database. As such, the data is stored as individual documents. A document is a data structure made up of one or more field/value pairs. Nearly everything you do in MongoDB is either directly or indirectly related to the documents that you store in a database or move in and out of …
The post Introducing the MongoDB Document appeared first on Simple Talk.
In this article, we look at a process to collect data to find unused SQL Server databases and send you email notifications about these unused databases.
In this article, we present some T-SQL code samples, results sets, and charts illustrating how to mine inverse ETFs to evaluate trading strategies.
This article discusses books, links, videos, and other material to prepare for the Microsoft exam DP-420 Designing and Implementing Cloud Native Applications Using Microsoft Azure Cosmos Database.
Learn about CData Connect Cioud which is a cloud-based data virtualization solution to integrate many types of cloud data sources using SQL Server Linked Servers.
Everything started in 1993, 30 years ago! This first version of SQL Server was created in an agreement between Microsoft and Sybase. Learn about the different versions of SQL Server over time.
Nearly a decade ago, I wrote a post called “Bad habits : Counting rows the hard way.” In that post, I talked about how we can use SQL Server’s metadata to instantly retrieve the row count for a table. Typically, people do the following, which has to read the entire table or index: To largely …
The post Counting more efficiently appeared first on Simple Talk.
Learn about SQLGrease an in-depth SQL query optimization tool using real time and historical data to solve complex SQL Server performance issues quickly. 
In this article, learn ways to query the sys.objects view in SQL Server to return various information about database objects in a database.
Learn about dbWatch the Swiss army knife for DBAs. It's an all-in-one instance-level monitoring tool that can track backups, uptime, disk space, and one of my favorite things, performance, for every instance in your farm.
Learn about SolarWinds' SQL Sentry designed to monitor SQL Servers, collect Key Performance Indicators (KPIs), highlight poorly performing queries, identify performance-related issues, and send alerts to notify DBA teams promptly.
Learn how to add a new data file to a SQL Server on Linux database and also how to move the file location for database files running SQL Server on Linux.
Imagine this: you have several directories full of SQL script files, and you need to know where a certain table is used. You’d rather like the context too, so you can check the whole SQL Expression and work out why it is running so slowly. Maybe, from that same daunting set of several directories, you …
The post Using a SQL Tokenizer appeared first on Simple Talk.
Learn how to pivot and analyze data in Power BI like you can do in Excel for fast and easy data analysis.
This article compares Azure Analysis Services with On-Premises SQL Server Analysis Services and why you might choose one over the other.
Learn about Microsoft Fabric and OneLake the storage layer for every possible compute in Fabric. OneLake is a single logical data lake for the entire Fabric platform in your organization.
In this article, we look at the steps to grant SQL Server access to new folders for backups or database files.
In this tip, we're going to look at the steps to backup SQL Server on Linux databases using SQL Server Agent on a Windows server.
This article provides step-by-step instructions to create a multi-node Apache Hadoop cluster that allows for the distributed processing of large data sets across multiple computers using simple programming models. 
In this article, we learn about DuckDB which is a free, open-source database management system intended for fast analytical query workloads. It supports SQL and is designed to run in-process and in-memory. 
Learn about Power BI vs Tableau reporting comparison with SQL Server data to see the query differences when retrieving data.
Learn about the WAITFOR command in SQL Server to delay processing for a period of time and how this could be used for testing.
In this blog, we continue our exploration on PostgreSQL indexes which we started here. In that article, we learned what an index is, and how exactly indexes can help with query execution. But there is much more to learn about indexes! In this blog, we will keep exploring B-tree indexes. We will learn whether (and …
The post Exploring PostgreSQL Indexes appeared first on Simple Talk.
In this article, learn about methods and tools that can be used to automate the ingestion of data into Microsoft Fabric.
This article explores check constraints in SQL Server and the impact they have or don't have on performance.
Learn about the general availability announcement of Microsoft Fabric including pricing, and mirroring.
There are times when a SQL Server database change is made and no one knows who made the change, when it was made, and what the change was. In this article, we look at how to capture these details with DDL Triggers.